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EXECUTIVE SUMMARY 



Analysis of procedures for allocating channels to randomly 
arriving message traffic by mathematical methods aids in making 
decisions. This paper provides an example. First, we provide 
some background. 

There are situations in which many different message sources 
independently compete for service at one, or a finite number of 
channels or other facilities. If one message is on the channel, 
and another applies, a conflict occurs, and both are destroyed, 
meaning that they go into a re-try or limbo state, from which they 
independently attempt to access the channel at random (exponentially 
distributed) intervals; of course retries can also collide and be 
destroyed, but the process continues indefinitely. 

The usual formulation assumes that messages appear in discrete 
packets; then, assuming an infinite message source, and that 
interrupted packets must re-start, the number in limbo will eventually 
increase indefinitely -- the process is unstable, with delays 
increasingly to infinity. Only by allowing for takedown or defection 
in the model can stability be reached. 

This report generalizes the classical model slightly to consider 
a long stream of very small packets. Interruption is still possible, 
but re-start is not required. It is shown that for this setup 
stability may be achieved provided demand rate is less than a critical 
value. The probability distribution of limbo state takes on a simple 
form, as do the low moments (mean and variance) . 



A RESOURCE CONFLICT RESOLUTION PROBLEM 
FORMULATED IN CONTINUOUS TIME 

D.p. Gaver 
G. Fayolle 

1 . Introduction 

In many situations involving data transmission from diverse 
sources there can be conflict for a limited number of channels 
or other facilities. Uncoordinated attempts by several sources 
to use a single facility can result in "collision," the 
"destruction" of all participants in the collision, meaning the 
loss of the transmission, and hence the need for re- transmission . 
An important problem concerns the development of workable proce- 
dures for alleviating the conflict and corresponding message 
delay problems. 

Often such problems are viewed as occurring in discrete time: 
slots of equal length occur in temporal succession, and each slot 
can handle just one packet of data at a time, if two or more 
packets try to use the same slot simultaneously, a collision 
occurs that somehow must be resolved. A recent paper by Fayolle, 
Flagolet, and Hofri (1983) , hereafter FFH , analyzes a stack 
protocol for handling such a situation, but there are many other 
proposals . 

This report is concerned with some simple models for conten- 
tion for a single facility (channel) , and for contention or 
conflict resolution. The models are formulated in a continuous- 
time manner: messages, or numbers of packets constituting 

messages, are "long," meaning that they occupy many consecutive 
slots on the average if a single transmission is occurring. 



2 . 



Model 1: Poisson Message Source, Single Facility 



Permit messages to arrive at a single facility (e.g., bus or 
satellite link) in Poisson manner with rate A. Service times are 
I IDExp ( u ) • When a message arrives it either: (i) encounters a 

free facility and immediately begins transmission, or (ii) inter- 
rupts ("collides with," "destroys") a message in progress; the 
result is that both messages are affected, and some retransmis- 
sion becomes necessary. 

In what follows we investigate a scheme to allow the messages 
to retransmit following interruption or collision. It can be 
called a stochastic stacking procedure. In a general sense it 
is patterned after the algorithm analyzed by FFI1 . 

2 . 1 Stochastic Stacking Model; A Single Limbo State 

Introduce this procedure: whenever a collision occurs, each 

message source selects a delay time for retransmission indepen- 
dently from the distribution Exp(v). While any message experi- 
ences the latter delay it will be said to occupy a limbo state ; 
the number of messages occupying the limbo state at time t will 
be denoted by X(t). Furthermore, let A(t) denote the state of 
the facility at t: A(t) = 1 if the facility is occupied with a 

message transmission, while A(t) = 0 if the facility is idle at 
time t. The idea of the delay time here qua 1 i ta t ively resembles 
the randomization scheme studied by FFH. 

Apparently -A(t), X(t); 0 >_ t ) is a Markov chain in continu- 

ous time. The forward Kolmogorov equations for the process 
can be written in terms of: 



P{X(t) = j ,A(t) = 1} , 



(2.1a) 



q j ( t ) = 



Pj(t) = P(X(t) = j , A ( t ) = 0) 



(2.1b) 



The probabilities in question actually depend upon initial condi- 
tions, i.e., values of X(0) and A(0), but these will be left 
implicit. Consider the evolution of the probabilities as 
f ol lows : 



p_. ( t+dt ) = p j ( t ) [ 1- \ dt-jv)dt]+q^_ 0 (t)Adt+q_._^(t)v(j-l)dt 

+ q.(t)pdt + o(dt) (2.2 a) 

1 

q_.(t+dt) = q_. (t) (1-Adt- jvdt-pdt] +Pj (t) Adt 

+ p (t) ( j + l)dt + o ( d t ) . (2.2b) 

Now subtract p.. ( t ) ( q ^ ( t ) ) f rom both sides of (2.2a) (2.2b), 

divide by dt and let dt — £0 to obtain the formal Kolmogorov 
equations : 

dp . 

— rr^- = - ( A + v-j ) p . ( t) + ^q _(t)+v(j-l)q. . ( t ) + uq . ( t) (2.3a) 

dt J 3 3~ ^ 3 ~ 1 3 



dq^ ^ 
dt 



- ( ) + \ j + ) q ( t ) + • p ( t ) + v ( j + 1 ) p j + ^ ( t ) 



(2.3b) 



A few words of explanation: in order for the system to be in 
state ( j , 0 ) at time t + dt it must have either: (1) been in that 



state at t, i.e., a moment before, and have experienced no 
change, or (2) been in state (j-2,1) a moment before, and 
experienced an exogenous (A-rate) arrival; the latter collides 
with the message on the facility, and both enter the limbo state, 
so the state changes to (j,0), err (3) been in state (j-1,1) a 
moment before and experienced an endogenous (from limbo state) 
arrival, or_ (4) been in state (j,l) and experienced departure 
of the message on the channel. This explains equation (2.2a); 
otherwise, in order that the system be in state (j-1,1) at time 
t+dt it must have either (5) been in that state at t, i.e., a 
moment before and thus experienced no change, o_r (6) been in 
state (j,0) and experienced an exogenous arrival which begins 
service on the channel, o_r (7) been in state (j + 1,0) a moment 
before and experienced an endogenous arrival, from a message 
that leaves the limbo state and entered the idle facility. This 
explains expression (2.2b). 

2 . 2 Long-Run or Steady State Conditions and Distributions 
To look for the conditions allowing a stable long-run 
distribution of {X(t),A(t)l set the time-derivatives to zero 
in (2.3a and b) and introduce generating functions for the limit- 
ing probabilities; by definition 



P (2) 



1 im ' p . ( t ) z ^ 
t j -0 ^ 




(2.4a) 



Q(z) = lim y p. (t)z ] 



l ci-, 23 

j = ° J 



(2.4b) 



where the latter limits are assumed to exist at least when 
|z| 1 . Performing the summations leads to these equations 

for the generating functions: 

AP(z) + vzP'(z) = [Az 2 + p]Q(z) + vz 2 Q'(z) (2.5a) 

AP ( z) + vP’(z) = (A + u]Q(z) + v zQ ' ( z ) (2.5b) 

Now multiply (2.5b) through by z, subtract from (2.5a), and divide 
by (1-z) to obtain 

A P ( z ) = (u-Az)Q(z). (2.6) 

If we put z = 1, this expression results in 

A [P (1) + Q ( 1 ) ] = pQ ( 1 ) , 

but since we assume an honest limiting probability exists, 
i . e . , that 



P(l) + Q ( 1 ) = l [ P { X = j , A = 0} + P{X = j,A = .1 } ] = 1 , 

3 = 0 



it follows that 



l q- = Q ( 1 ) = ^ = P (0 < p < 1) . (2.7a) 

j = 0 3 U 



and that 



l p. = P(l) = 1-p (2.7b) 

j=0 3 



Further information results by differentiating (2.6) and substi- 
tuting into (2.5b); the result is the simple differential 
equation 



Q' (z) 
Q ( z) 



A ( 1 + z ) + v _ A, A ( 1 + z ) + v . 
v (j- - 2z) v u “ 2Az 



_A_ 

2 v 



+ — ( A + v + -^ ) 



2 u - 2 A z 



( 2 . 8 ) 



which can easily be integrated to yield 



in[ Q(l) ] 2v (1 ' z) + 2v ( A + V + £n ( p U - 2Az } 



or, utilizing the value of Q(l) , 



Q( z) 



P [e 



2v 



( 1-z) 



( 



1 - 2p 

1 - 2pz 



) 



, A +v + u/2 , 
' 2 v ' 



) 



(2.9) 



so the ergodicity condition immediately appears to be 0 ^ p 
It then follows from (2.6) that 



< 



1 

2 ' 



P ( z) 



(^ - z) Q(z) , 



( 2 . 10 ) 



and hence the generating function of total system occupancy 
(server plus limbo) is 



H ( z ) 



E [z 



X+A 



] 



= P (z) + zQ(z) 



2v 



(1-z) 



A + v + |j/2 
1 - 2p * •, 2v 
1 - 2 A z J 



( 2 . 11 ) 



0 < 2p < 1 . 



Differentiation of H(z) at z = 1 generates cumulant-like 
objects that can be converted to moments. These result in: 

E [X + A] = r I 2p (1 + 2 P ; (2.12) 

p(l + p ( 3-p) Jf) 

Var [X+A] = , 0 £ 2p < 1 (2.13) 

(1 - 2 p ) 

Apparently both the mean and variance of total system occupancy 
decrease monotonically with a decrease in v \ the mean delay 
time selected by (or for) any colliding message. This suggests 
that the best control policy is to insist that interrupted 
or destroyed messages should immediately try again for trans- 
mission, if one is guided by an assessment of mean system delay 
time by Little's Formula. 



2 . 3 Inversion of H(z) When Limbo Delays Are Short 



Suppose v -> 00 in (2.11), signifying retransmission after 
a negligible delay in the limbo state. Then H(z) approaches 



H 0 <z) 




2p 



2pz' 



1/2 



0 < 2p < 1 . 



(2.14) 



The latter resembles the ordinary M/M/1 queue generating function, 
but the power 1/2 instead of 1 is noticeably different. Recog- 
nition that the generating function is that of a particular nega- 
tive binomial distribution yields the explicit formula 

r ( j + i> 1/2 j 

P{X + A = j } = =-(l-2p) (2p) ; j = 0,1,2,... (2.15) 

ji r<±) 



Suppose for one moment that perfect information were available, 
and that arriving messages could be queued before transmission 
on the system; no collisions can occur. Then the probability 
distribution of the total number in the system is well-known to 
be geometric. 



P{X + A = j } 



(1 - P) P j 



0 < p < 1 



(2.16) 



and 



E [ X + A] = (2.17) 

1 - p 

It then appears from Little's formula that the ratio of long-run 
expected total delays in the collision-prone but stacked, and the 



queued systems is at best 



E [Delay Stacked] 
E [Delay Queued] 



1-P 
1 - 2p ' 




0 _< p < 1/2 

as p -*• 0 . 



( 2 . 18 ) 



which clearly reveals the advantage obtainable if information 
can somehow reduce or remove collision frequency. 



3 . The Busy Signal Problem. 



Consider the following classical problem, historically pre- 
ceding the conflict problem previously discussed, but of interest 
in its own right. A telephone line serves a number of customers. 
At moments of a Poisson process of rate A customers attempt to 
initiate calls on the line; if the line is free it is captured by 
a caller for an exponentially distributed time, mean y ^ . If a 
call is in progress when another call arrives the newcomer hears 
a busy signal, hangs up and tries again (retries) after an exponen 
tially distributed time, mean v ^ ; he continues to re- try, along 
with others who have experienced busy signals, in such a manner, 
i.e. at independent exponential (v) intervals until he accesses 
the line and can initiate, and eventually complete, his call. 

The above familiar setup is very similar to the conflict 
resolution problem just addressed, but has no "collision" or 
"destruction" features. Note, however, that certain proprietary 
telephone systems do have a destruction feature for low priority 
calls. Thus the U.S. Dept, of Defense AUTOVON system allows high 
priority calls to displace ones of low priority. It seems reason- 
able to model this latter situation using a limbo or retry state 
much as we did the previous conflict problem. The present discus- 
sion models only the single-priority setup. 

3 . 1 Probabilities for A Single Limbo or Retry State . 

Again consider the vector Markov chain { A ( t) , X ( t ) , t >_ 0 } , where 
A ( t ) = 1 if the line is occupied, and = 0 if the line is free, 
while X(t) is the number in the limbo/retry state. Again 



P{X(t) = j ,A(t) =1} 



(3.1, a) 



qj(t) = 

Pj(t) = P{X(t) = j , A (t) = 0} ; ( 3 . 1 ,b ) 

we will write formal Kolmogorov equations to describe the 
evolution of the probabilities: 

Pj(t+dt) = Pj (t) [1-v jdt-Adt] + q j ( t ) pdt + o(dt) (3. 2, a) 

q ^ ( t+dt ) = q^(t) [ 1-v jdt-Adt-pdt] + q^_ 1 (t)Adt 

+ Pj + i ( t) v ( j + l)dt + p_.(t)Adt + q^(t)vjdt . (3.2,b) 

The usual steps yield the differential equations 

= Mq j ( t) ( 3. 3 ,a) 

Acg • _ (t) + v(j + l)p (t) +Ap.(t) . ( 3 . 3 ,b) 

Notice that the effect of one possible change, i.e. that in which 
a retry population number retries and again gets a busy signal , 
can be removed, for there is no net change in state. 

3 . 2 The Long-Run Distribution . 

$ 

Assume now that a long-run distribution occurs, and search 
for the necessary conditions and the distributional form. We 
must solve the balance equations obtained by zeroing the 
derivatives in (3.3): 



dPj 

dt 



- ( A + v j ) Pj ( t) 



dqj 

dt 



- ( A+p) q j ( t ) + 



(A+vj) Pj 



(3. 4, a) 



= yq. 



( A + y ) q j = ^qj_! + v(j+l)Pj +1 + Ap^ 



( 3 . 4 ,b) 



Introduce generating functions 



P(z) = l z^p , Q(z) = l z 3 q. 

j =0 3 j =0 J 



(3.5) 



With a little calculation it can be shown that 



AP(z) + vzP'(z) = yQ(z) 



(3. 6, a) 



(A+y)Q(z) = AzQ(z) + vP'(z) + AP(z) 



( 3 . 6 , b) 



by multiplying (3.4,a) and (3.4,b) through by z 3 and summing, 
as before; the primes denote z-dif ferentiation . To solve, 
multiply (3.6,b) by z and subtract from (3. 6, a) to obtain 



A (P (z) + zQ ( z ) ] = yQ(z) 



(3.7) 



after division by 1-z; whence 

A[P(1) + Q ( 1 ) ] 5 A = pQ ( 1 ) 



so 



lim P { A ( t ) = 1} 

■£->00 



Q ( 1 ) 



A 

u 



p , 



(3.8) 



the probability of a busy line in the long run (p < 1) . Next 
rewrite (3.7) as 



P(z) = (1/p - z)Q(z) 



(3.9) 



and differentiate, 



P'(z) = (1/p - z)Q'(z) - Q ( z ) ; (3.10) 



finally substitute for P and P' from (3.9) and (3.10) into (3. 6, a) 
to obtain the differential equation 



Q ' (z) 



1 + A/v 

1/p " z 



Q ( z) 



(3.11) 



which is immediately solved to yield 



Q(z) 




1 + A/v 



(3.12) 



an expression for P(z) comes from (3.9), and finally 



lim E [ z 



X(t) +A(t) j 



£->°o 



P ( z ) + zQ ( z) 



, 1 ~ P i 1+A/v 
[ 1 - pz’ 



(3.13) 



It follows by inspection that the stationary distribution of 
system occupancy, including the channel occupant and retry 
population, is now negative binomial: 



r ( 1 + A/v+j) 
j iru+A/v) 



(3.14) 



lim P { X ( t ) +A ( t ) =j} 

t-»-oo 



P D (1-p) 



1 + A/v 



Note that if v -» 00 the generating function of (3.13) tends to 
( 1-p) / ( 1-pz) , that of the geometric distr ibutionof occupancy 
of the M/M/1 system that permits queueing. This is quite 
intuitive, for infinitely frequent retries look to the system-- 
if not the customer--exactly as if arrivals are queued. There 
is a decided difference between (3.13), or even (3.13) with 
v -*■ °° , and the corresponding collision-destruction model, with 
generating function (2.11) or (2.1 ). 
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SOME COMMENTS ON A “RESOURCE CONFLICT RESOLUTION 
PROBLEM FORMULATED IN CONTINUOUS TIME” 

Alan Weiss 

AT&T Bell Labera tones 
Murray HD1, New Jersey 07974 

It is we I] known that slotted Aloha schemes are itrcngly unstable when there are an infini te 
number cf sources. Yet Gaver and FayoOe [G-F], in the paper referred to in the title, find that, for 
2p < 1, a continuous time Aloha scheme is stable. In this note we try to explain this discrepancy 
via seme elementary calculations which illuminate the structure cf the model analyzed in [G-F]. 
We use the notation cf [G-F]. 

Consider X(r) - A(r), the total number of messages in the system at time r . We shall see that 
this process is approximately a birth-death process with birth rate X and death rate u /2 when 
X (r ) - A (r ) is large. Furthermore, we wQ show that A(t) - 1 about half the time when X - A 
is large, and we wlD develop some further consequences cf our viewpoint. 



To begun with, suppose that A"(0) - AT b large and that >4(0) “ 0. After a time which is 
(istribured exponentially with mean ^ * ~ either a message goes from hmbo to 

A* v X 

transmission (with probability — - 1 - — ■ ) cr a new message arrives (probability 

~ 7 —). Obviously, the meat likely event is that a message goes from limbo to 

transmission. In that case, after another cxponentiaDy distributed time with mean 

* = - 7 — t either another message from limbo collides with the frst (probability 

X — (a — l)v |x Av 

X 1^ ^ 1 ” ^ A ; - “ ) ’ ^ ^ rSt message completes transmission (probability 

~ cr a new message amves and collides with the first (probability 

X (A — 1 )v — ^ Av 

— = 77 -). In anv case we see that in a (short) time 

X — (A - 1 )v A v 



A.-f 



we have a new arrival with probability 



• 2. 



p (new) ~ ~ \M , 

A V 

a successful transmission with probability 

p (success) = ~ £ A/ ; 

and a return to the initial condition X m K, A ■ 0 with probability 

p (return) ~ 1 - XAr - ^ Ar . 

That is, the process is approximately birth-death with birth rate X and death rate p/2. Furthermore, 
the channel is idle for times of length ~ •— and is busy for times of length = , so that half 

the time is spent busy (this is another way of saying that the death rate is &). This clearly shows 

2X 

that the stability condition is — ■ 2p < 1. WhQe the preceding argument is not rigorous, it is not 

hard to tighten up, but in light of [G-F] there seems to be no point in doing so. 

Let is carry our reasoning a bit further. We have (X(r) + A(r)) is approximately a constant- 
coefficient birth-death process for large values of X + a ; hence in steady state, we should have as K 
becomes large, 

/>(x(0+A(0-i:) = c(2p)‘ 

for some C > 0. Using the notation in [G-F] this is 

Pk +q t . x ~C(2pY . ( 1 ) 

Also, since the process spends about the mine amount of time in state (X m K , A m 0) as in 
(X -X -1, A « 1), we should have 

Pt ~ <U -i ■ ( 2 ) 

Together these two equations imply that 

tyt m Wr ~ -i * 

which is the key equation (26) in [G-F], Furthermore, equation (1) is the same as their equation 

2 . z. 

2J6 if we replace C by VI - p. 



-3- 



Now our reasoning was valid as long as AT v was large. Instead of assuming that K was large, we 
could as well have supposed that v was large. In this case we have 



_ 1 _ 1 _ IX -1 

Kv {K - l)v “ K(JF - l)v 

p (SUCC®*.) = - -V * • 

K 

The birth rate, of course, remains X_ Then by a basic formula cf birth-death processes 



K X, 

/’(state - AT) «C n — for same C > 0 

7-1 

we have 



P(X(t) + A(r) - K ) -/* + 9r ., 



-c n - 


-I-* 

1 

«N 


)• 1 J 


2 r r 


K *\ 


r 


t 

* + f 



Cf 



vn k\ 



(2p) r 



which is the equation (215) in [G-F] far the choice C “ Vl - 2 p. 



We can also analyze the effects of changing the model. In [G-F], any transmission, no matter 
how short, reduces the remaining length cf a message. In fact, we saw that when X (t ) is large, the 
system takes very small ‘bites” very quickly. New a realistic system may have some overhead, say 
a time &, which must pass before a new transmission may start. Or there may be some basic unit to 
be transmitted such as a packet or length &, and if the transmission is interrupted in the middle cf a 
packet then the entire packet nn&t be retransmitted. Or there may be a time delay 8 through the 
system so that when an interruption takes {dace, the last & of the message must be retransmitted to 
assure its safe delivery. We model any cf these cases by assuming that transmissions which are 
shorter than a fixed time & are ineffective. 



We shall new demonstrate that this system is strongly unstable; that is 



Furthermore we shall show that 



-4 - 



F(hmX(/) -x) -1. 

I- » 



P (total number cf successful transmissions is finite) * 1; 
that is, we will shew that, with probability 1, there is a random finite time T such that no successful 
transmissions take place after time T . To this end, consider the probability that at least one 
message which attempts to transmit during a time when X(f ) + A(t) m K finch no uninterrupted 
interval cf length at least ft. This is bounded by the probability that in a time interval cf 
exponentially distributed (X.) length, a Poisson process with rate K v has no consecutive events more 
than 5 apart; that is, 



P (no transmission) > £ (1 -e' 4 '") 7 * 1 
/-i 



1 - 



Kv + X 



(1 - a—) 



Ifv + X | Afv + X 

_1 

1 -(1 -e—)(l - 



Kv + X 



) 



-1 -Kx*-*’ + 0(e~ u ' r ) 



That is, 

/’(transmission) < + O^* 4 * *) 

Hence by a Bcrd-CanteDi argument we may conclude that 



P (infinite number cf transmissions) “ 0 

Since 

2 ^w"“ , + 0(e- 4r ’) < x 

X -H 

for all positive values cf N ,K and & 

Suppose now that the overhead ft is a random variable instead of a constant. Then if 
/’(ft ■ 0) - 0, the queue is strongly unstable, although for some distributions cf ft an infinite number 
of messages may get through. This can be seen as follows: work is dene an a message only after 



overhead is completely serviced. If the overhead distribution has a continuous density f(X) rear 
X « 0, then successful completion cf overhead occurs approximately as a Poisson process with rate 
/( 0)/2. After each successful overhead completion, a message gets about 1/vJf (f ) time to transmit. 
Now X (t) will dearly be an the order of X/ for large t, so successful message transmissions will 
occur at a rate cf about / (0)/2X/vfor large t . The analysis cf other types cf overhead distributions 
is straightforward and is not defined here. 



Let us now suppose that message lengths are not exponentially distributed, but have instead a 
distribution function F(X). Then it is not hard to see that if the failure rate cf F(X ) (namely 






-) remains abeve a level p, where 2 X/p, < 1, then the system is stable. This follows 



1 -F(X) 

directly from our original analysis. As our final model, consider the differences between Gaver calls 
“resume,” “restart,” and “new” disciplines. “Resume” is the original model, where each 
transmission, no matter how short, reduces the remaining length cf a message. “Restart” is an all- 
or-nothing situation. Either the entire message gets transmitted, cr if interrupted it must be entirely 
redone. “New” is where each message picks a fresh length at the start cf each transmission, 
independently from a distribution F(X). That is, each message length is a new i id. random 
variable in each transmission attempt. This might arise, far instance, in a simulation where the 
programmer does not keep trade cf each message length separately, but instead picks a new length 
each time. The first case (resume) has already been discussed. “Restart” b easily seen to be 
strongly unstable by the same sort cf reasoning we used far analyzing overhead, and the reader b 
invited to fill in the details. We shall new show that when F(X ) has a continuous density f(X) 



near 0, “new” b stable if and only if 2X//(0) < 1. That b, the three cases are quite different, and 
so simulations must be done quite carefully. The analysis b nearly identical to the “resume” case: 
in each time interval cf length A/ ~ 2 IK v, we have a probability cf abut / (0)Ar/2 cf a successful 
transmission. In fact the probability cf a successful transmission b half the probability that a 
random variahle with distribution function F(X) b less than an independent exponentially 
distributed variable with mean 1/JTv, so 



• 6 * 



/’(successes) ~ J f 0 f(s)ds 

~ f(0)!2K v . 
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